Papers with cross-encoder model
Cross-Encoder Data Annotation for Bi-Encoder Based Product Matching (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to match seller listed items to appropriate product are computationally heavy and require computational resources. |
| Approach: | They propose a technique to annotate or refine human annotated training data for bi-encoder models using a cross-encoding model. |
| Outcome: | The proposed approach improves 4% absolute accuracy when no training data is available and 2% when annotated training data exists. |
Question Answering Infused Pre-training of General-Purpose Contextualized Representations (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing pretraining objectives for question answering (QA) are not optimized for being immediately useful without fine-tuning. |
| Approach: | They propose a pre-training objective based on question answering (QA) that is based more directly on context. |
| Outcome: | The proposed model matches predictions of a more accurate cross-encoder model on 80 million synthesized QA pairs and achieves large improvements over previous state-of-the-art models on paraphrase detection and fewshot named entity recognition. |
Efficient Nearest Neighbor Search for Cross-Encoder Models using Matrix Factorization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Efficient k-nearest neighbor search is a fundamental task, foundational for many problems in NLP. |
| Approach: | They propose an approach that avoids the use of a dual-encoder for retrieval, relying solely on the cross-encoding model. |
| Outcome: | Empirically, for k > 10, our approach provides test-time recall-vs-computational cost trade-offs superior to the current widely-used methods that re-rank items retrieved using a dual-encoder or TF-IDF. |